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COMMUNICATIONS NETWORK 

The invention relates to communications networks in which a 
local area network (LAN) is connected to a wide area network 
5 (WAN), via a plurality of communications links. 

For domestic users it is conventional to access the Internet 
and the World Wide Web using dial-up connections over 
telephony links. There is an increase in the use of 

10 broadband connections, which are either provided over cable 
TV networks or by DSL over the PSTN. However, there are some 
communities for which it is not possible to provide with 
broadband connections, either because they are too far from a 
CATV network or a PSTN exchange or because there are 

15 insufficient numbers to make a broadband installation 
economic for the network operator. 



According to a first aspect of the present invention there is 
provided a method of sending data over a communications 

20 network, the method comprising the steps of an originating 
terminal generating a request for a content server; the 
originating terminal dividing the request into a plurality of 
packets; the originating terminal distributing the plurality 
of packets to a first plurality of terminals over a first 

25 network; the first plurality of terminals transmitting 
packets received during step to a reconstitution server 
located in a second network, the first plurality of terminals 
being connected to the second network by a second plurality 
of connections; the reconstitution server receiving the 

3 0 plurality of packets and sending the request to the content 
server. Additionally, the content server sending a plurality 
of content data packets to the reconstitution server in 
response to the request received previously; the 
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reconstitution server distributing the plurality of content 
data packets to the first plurality of terminals over the 
second plurality of connections; the first plurality of 
terminals sending the plurality of content data packets to 
5 the originating terminal; and the originating terminal 
receiving the plurality of content data packets to re-create 
the content data. 

Preferably the plurality of packets are distributed to the 
10 first plurality of terminals in a round- robin basis. It is 
further preferred that the round- robin distribution of the 
plurality of packets is weighted and that the round-robin 
weighting is determined in accordance with the bandwidth of 
the connection between the terminal and the second network. 

15 

According to a second aspect of the present invention there 
is provided a communications network comprising; a first 
plurality of terminals, the terminals being connected by a 
first network and having a second plurality of connections to 

20 a second network, the second network comprising a 
reconstitution server and a plurality of content servers, 
wherein, in use, an originating terminal generates a request 
for one of the content servers, divides the request into a 
plurality of packets and distributes the plurality of packets 

25 between the first plurality of terminals via the first 
network, the plurality of packets are sent to the 
reconstitution server via the second plurality of 
connections, the reconstitution server sending the plurality 
of packets to the content server. Furthermore, the content 

3 0 server sends content data to the reconstitution server, the 
reconstitution server divides the content data into a 
plurality of content data packets and distributes the 
plurality of content data packets between the first plurality 
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of terminals over the second plurality of connections, the 
first plurality of terminals distributing the plurality of 
content data packets to the originating terminal; the 
originating terminal receiving the plurality of content data 
packets and re-creating the content data. 

The first plurality of terminals may be greater than the 
second plurality of connections or the first plurality of 
terminals may be less than the second plurality of 
connections. Each of the first plurality of terminals may 
comprise a list identifying the other active terminals. Each 
active terminal may periodically send a first status message 
to the other terminals to indicate that it is active. 
Furthermore, an active terminal may send a second status 
message to the other terminals prior to becoming inactive. 

According to a third aspect of the present invention there is 
provided a reconstitution server, the server, in use, 

receiving a plural ity of packets from a first plural ity of 

terminals, and sending the request to a content server 
identified by a request . Preferably, the server, in use, 
receives a plurality of content data packets from a content 
server in response to the request and distributes the 
plurality of content data packets between the first plurality 
of terminals. The reconstitution server may be in 
communication with the first plurality of terminals via a 
second plurality of connections. 

A preferred embodiment of the invention will now be described 
by way of illustration only and with respect to the 
accompanying drawings, in which 
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Figure 1 shows a schematic depiction of a communications 
network according to the present invention; and 
Fiaure 2 shows schematic depiction of the implementation 
of Layered Service Providers (LSP) in a communicatxons 
network according to the present invention. 

Figure 1 shows a schematic depiction of a communications 
network according to the present invention, comprising LAN 
100 and WAN 200. The LAN 100 comprises a plurality of LAN 
terminals 110a, 110b, 110c, ... each of which are connected to 
one or more other terminals 110 by LAN connections 115. 
Furthermore, the LAN comprises one or more WAN connections 
120 that connect a LAN terminal to the WAN 200. The WAN 200 
comprises one or more network access servers (NAS) 210a, 
210b, reconstitution server 230 and a plurality of content 
servers 240. LAN terminal 110c has a WAN connection 120 to 
both NAS 210a and 210b, whilst LAN terminal 110e has no WAN 
connection 120 and only a LAN connection 115.' 

in operation, a LAN terminal 110 may communicate with one of 
the content servers using a plurality of the WAN connections, 
so as to provide increased bandwidth for the communicate. 
Conventionally, the request to access a data resource stored 
on a content server comprises a number of packets and these 
packets are transmitted to the content server using the WAN 
connection associated with the terminal. 

Using a method according to the present invention, terminal 
Toa distributes the request packets amongst the other LAN 
terminals, with the LAN terminals transmitting the reques 

Lkets to the WAN via the WAN connections. The request 
packets are numbered sequentially and are routed, vx. the NAS 
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210 to the reconstitution server 230, where the request 
packets are sent to the appropriate content server 240. 

In response, the content server delivers the requested data 
resource in the form of a plurality of data resource packets 
to the reconstitution server. The data resource packets are 
then transmitted to the plurality of LAN terminals, via the 
respective NAS / using the plurality of WAN connections. 

When the data resource packets are received by the LAN 
terminals the packets are forwarded to the LAN terminal that 
initially requested the data where the data resource packets 
can be re-assembled in the correct order and the data 
resource accessed by the terminal. Thus, the present 
invention enables a LAN terminal to aggregate the plurality 
of WAN connections in order to provide a virtual connection 
having an increased bandwidth. 

It is preferred that the LAN terminals are connected via the 
LAN using the Internet Protocol. Any LAN transport medium 
may be used, including standard Ethernet cables, wireless LAN 
technology (such as 802.11b/g or Bluetooth), IP over 
electricity lines, etc. It is also preferred that each LAN 
terminal has an active WAN link in addition to a LAN 
interface (it is possible to have one or more LAN terminals 
which do not have a WAN connection, although this will have 
the effect of reducing the efficiency of the present 
invention as the ratio of LAN terminals to WAN connections 
will be reduced. Typically the WAN link will be a PSTN or 
ISDN dialup connection, with connectivity to the global 
internet via any ISP. It should be understood, however, that 
other access technologies such as DSL, cable modems, 
satellite, etc. can also be shared using the method of the 
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present invention. Typically the WAN will be the Internet, 
although it may be a corporate or academic WAN. The NAS will 
typically be operating protocols such as SLIP (Shared Line 
Internet Protocol) and/or PPP (Point to Point Protocol) to 
control the communications over the plurality of WAN 
connections . 

The LAN terminals typically comprise a standard PC running 
popular client applications such as e-mail, WWW browser, 
media streaming, network games, etc. Additional routing 
software is installed onto the LAN terminals which ensure 
that outgoing packets are re -directed to active LAN 
terminals. There are various ways of accomplishing this 
including placing the network card into promiscuous mode, 
creating a v default route' or a platform specific method, 
such as Layered Service Providers (LSP) for Microsoft 
Windows. In the example discussed below it will be assumed 
that the LSP method is used. It will be understood that the 
invention may also be implemented on PCs using other 
operating systems, such as Linux and Macintosh OS, or on 
other devices such as set top boxes, game consoles, etc that 
are capable of making network connections. 

Figure 2 shows a schematic depiction of the implementation of 
LSP, in which LSP (Layered Service Providers) 113 is created 
as a 'dummy' layer, in between the TCP/IP application 112 and 
the TCP/IP stack 114. If LSP is implemented then outgoing 
packets are trapped: if the packet is destined for a local 
host, then the packet is allowed to pass unmodified to the 
TCP/IP stack; whilst if the packet is destined for a remote 
network the packet is sent to one of the LAN terminals. As 
the packet's destination address has now changed, the 
original intended destination IP address and port need to be 
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appended to the packet's payload. It is possible to 
determine whether a packet is routed to a remote or local 
host using known methods, such as examining the LAN card's 
host mask. 

5 

In order for packets to be routed to LAN terminals 
efficiently it is necessary that each LAN terminal is aware 
which of the other LAN terminals are active. Each active LAN 
terminal notifies the other LAN terminals and the 

10 reconstitution server that they are still active by 
periodically transmitting an "ACTIVE" message. If a LAN 
terminal is to be shut down, i.e. the terminal is being 
switched off then a "SHUT DOWN" message will be transmitted. 
In the event that a LAN terminal goes down unexpectedly e.g. 

15 power is lost, then the other LAN terminals and the 
reconstitution server can infer that a LAN terminal is no 
longer active by the failure to receive "ACTIVE" messages. 

If a LAN terminal fails to transmit an "ACTIVE" message for a 
2 0 predetermined period of time then it will be removed from the 
table of active LAN terminals, which is used to determine 
which terminals packets may be sent to. If a LAN terminal has 
shut down unexpectedly and other LAN terminals are still 
sending packets to it then there is no way to recover this 
25 situation. To the applications generating a request packet it 
will appear as if there was network congestion and the 
packets were dropped. If the application uses a reliable 
transport such as TCP then lost packets will be automatically 
recovered . 



30 



The LAN terminals status messages may be sent using unicast 
(typically UDP) messages to each of the other LAN terminals, 
however since LANs are generally a shared media, a more 
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efficient means of accomplishing this is by sending multicast 
or broadcast messages. It is preferred for the LAN terminals 
to send status messages to the reconstitution server using 
UDP or TCP. In a preferred embodiment, a LAN terminal can be 
inferred to be active if it is still sending packets for 
forwarding and thus there is no requirement for LAN terminals 
to send status messages if they are currently sending 
packets . 



LAN terminal 
IP address 


Port Number 


Missed 
Announces 


Weight 


10.0.1.3 


7654 


0 


1 


10.0.1.4 


7654 


5 


1 


10.0.1.5 


4567 


2 


3 



Table 1. 



Table 1 shows a typical LAN terminal router list. As well as 
listing the IP address of active LAN terminals a port number 

15 is also advertised. This allows a single LAN terminal to run 
multiple instances of the router software e.g. a single 
computer could have 8 phone lines and modems connected to it. 
LAN terminals allocate one port which other LAN terminals 
send packets to, and may possibly allocate a further port for 

2 0 packets being received from the reconstitution server. 



25 



When a LAN terminal sends requests to the other LAN 
terminals, the request may be sent using a simple round-robin 
technique. While this is simple to implement, it may not be 
particularly efficient if the different LAN terminals are 
have WAN connections that have significantly different 
bandwidth capacities. 
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According to a preferred embodiment of the present invention 
all LAN terminals have an associated weighting value which 
signifies the capacity of the WAN connection to route packets 
to the WAN. For example a 28.8kbps modem might have a 
weighting of 1, a 56kbps modem a weighting of 2, a dual ISDN 
dialup a weighting of 4, 500kbps ADSL a weighting of 18, etc. 
These weightings are used to determine the LAN terminals to 
which packets will be routed. For example, if LAN terminal A 
has a 56kbps connection, LAN terminal B has a 28.8kbps 
connection and LAN terminal C has a 56kbps connection and the 
reconstitution server wants to send a 5 packet response, it 
would balance the responses across the 3 LAN terminals as 
follows: A, B, C, A, C. 

The LAN terminals may have different weightings for upstream 
and downstream transmissions as many access methods do not 
have symmetrical upstream and downstream bandwidths . 
Weightings can either be set manually by a user (or the 
network administrator) or can be worked out automatically by 
0 monitoring the throughput associated with various upstream 
and downstream data transfers 

When a LAN terminal receives a packet from one of the other 
LAN terminals it verifies that the packet is valid, e.g. the 
15 checksums are correct, and if not the packet is dropped. If 
the packet is valid, the packet header is modified whereby 
the new source IP address and port are that of the LAN 
terminal's and the new destination address is that of the 
reconstitution server. 



30 



On LAN terminal start-up, the terminal contacts a 
reconstitution server in order to log onto the server (some 
form of terminal identification and authentication may be 
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required) . The reconstitution server will inform the LAN 
terminal which port it should communicate on and information 
is stored as an additional field in the active LAN terminal 
list held on the reconstitution server. The LAN terminal 
will use this port to communicate with the reconstitution 
server until the reconstitution server advises of an update. 

As well as modifying the packet header, the LAN terminal 
needs to append the IP address of the originating LAN 
terminal to the packet, adding 4 additional bytes to the 
payload. This is in addition to the 6 payload bytes already 
added recording the content server IP address and port when 
the LSP layer forwarded the packet. The port number of the 
originating LAN terminal does not need to be encapsulated in 
the payload as the outgoing port of this packet will be set 
to have the same value. 



20 



25 



When the reconstitution server receives an IP packet from a 

LAN terminal, it checks that the sender is authorised to use 

the service. It then creates a dedicated output port that is 
associated with the IP address and port of the originating 
LAN terminal. It then knows that any responses received on 
that dedicated port are destined for the particular IP 
address and port. 



Dedicated Port 


54725 


Source IP 


10.0.1.1 


Source Port 


5173 


LAN identifier 


15 


Last used timestamp 


2135325385 



Table 2 
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The reconstitution server maintains a table of the dedicated 
output ports, and what hosts they map to (see Table 2) . If an 
incoming dedicated port is not used for a pre -determined 
period, for example 5 minutes, then the port is made 
5 available again for re-use as it is assumed that there is no 
further traffic coming. When the port is used, that 'last 
used' timestamp is updated, where the timestamp is stored in 
32 bit UTC time format (UTC represents the number of 
milliseconds since 1 st January 1970) . When a packet is 
10 received containing an IP address and port number for an 
originating LAN terminal that are not currently represented 
in the table a new port entry is made. 

The reconstitution server then sends the packet to the IP 

15 address and port of the content server from the dedicated 
port (specifying its own IP address as the source IP address 
for the hop) , after stripping out the 10 bytes added to the 
payload as they are no longer needed. When the content 
server responds it will send its response to the dedicated 

2 0 port at the reconstitution server. The reconstitution server 
determines which LAN the packets are destined for and 
performs a weighted round-robin decision to determine which 
of the LAN terminals the packets should be sent to. Before 
the packets are sent the IP address of the content server and 

25 the IP address and port numbers of the originating LAN 
terminal are appended to the packet "payload so that the 
originating LAN terminal can re-create the intended packet 
header. The content server's port number can be inferred by 
setting the outgoing port number to the same - thus saving 2 

30 bytes payload overhead. 

When the LAN terminal receives a packet, it extracts and 
removes the originating LAN terminal IP address and content 
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server IP address/port numbers. It then re-creates the header 
that the originating LAN terminal expects to see, by 
replacing the source/destination IP address and ports. The 
LSP stack on the LAN terminal will only modify outgoing 
5 packets, not incoming, and so the packet is passed to the 
application layer unmodified. 

This system uses principles similar to IP firewalls and 
network/port address translation software and as such 

10 inherits some of its inherent limitations such as outgoing 
initiated data transfers are only allowed, and externally 
initiated data transfers are not generally allowed without 
building exception rules into the software. This prevents, 
for example, many peer to peer and locally hosted web 

15 services from working. 



An example of packet routing is given in Appendices A-D 
below. A UDP client-server application called 'AddltUp' is 
assumed, in which the client sends three packets each 
2 0 containing a number. The server responds by echoing the 
negative of the number back to the client. When the server 
receives the third number, it adds all three numbers up and 
sends back a fourth packet containing the summation of the 
three numbers . 

25 

The LAN terminal IP address is 10.0.1.1 and uses port 8111 
for incoming and outgoing traffic for that application. The 
content server 7 s IP address is 132.146.15.101 and uses port 
7111 for incoming and outgoing traffic for that application. 
30 The LAN housing the LAN terminal has identity 15 and has been 
given the port 10015 on the reconstitution server for 
incoming traffic. The reconstitution server's IP address is 
200.101.55.1 The reconstitution server and the originating 
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LAN terminal know that the following LAN terminals are 
currently active on LAN 15 : 



IP Address 


Port 


Missed Announces 


Weight 


10.0.1.3 


7654 


0 


1 


10.0.1.4 


4567 


2 


1 



Table 3 



The present invention will work even if the LAN terminals use 
different ISPs to connect to the internet. However, if all 
LAN terminals use the same ISP and the ISP deploys a 
reconstitution server on their network, the amount of overall 
backbone traffic is reduced as there is less traversing of 
backbone networks. In addition the data flow will be more 
predictable, increasing the quality of some services such as 
media streaming, as packets routed via the networks of a 
number of ISPs may take radically different paths across the 
Internet, and this can be a cause of packet jitter. 

Extensive research has shown that single user Internet 
connections are typically left unused 90% to 95% of the time 
as users. Therefore it is unlikely that there would be much 
local contention problem. Additional policy enforcement can 
easily be added to ensure a single user within the community 
does not use a disproportionate amount of the shared 
bandwidth. 

With shared network connectivity it is possible for users to 
utilise their phone line for voice calls etc. whilst still 
using the Internet (via the collective connections) . Normally 
a user has to disconnect from the Internet to use their phone 
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line for calls. The same principles can be applied to non-IP 
networking technologies such as AppleTalk. 

It is envisaged that the invention is suitable for use in 
communities in which it is not possible, for economic or 
technological reasons, to provide broadband services such as 
DSL or cable internet links. By aggregating a number of PSTN 
and/or ISDN links it is possible to provide users with a 
greater bandwidth, that with a sufficient number of users may 
approach or exceed that provided by DSL. The invention may 
also be used to aggregate broadband connections to provide a 
connection having further increased bandwidth. Groups of LAN 
terminals may be organised into a community that share a 
number of WAN connections. It is possible that a single LAN 
may comprise more than one such community of LAN terminals 
and that a LAN terminal may be a concurrent member of more 
than one community of LAN terminals. 

The invention may also be implemented within offices and 
campuses, etc., as telephone lines can be used for data 
services when not being used for voice services. The use of 
the phone lines may replace or complement a dedicated 
Internet connection. ISDN would be ideal for such an 
application as it has a quick setup/tear down process. 
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APPENDIX A 



Packet 1 



AddltUp Client. 
Send l 44' . 


Source: 10.0.1.1 port 8111 
Destination: 132.146.15.101 
port 7111 
Payload: 44 


T»^P interceDts. Sends to 
first LAN terminal in active 
list 


Source: 10.0.1.1 port 8111 
Destination: 10.0.1.3 port 7654 
Payload: 44 
(132.146.15.101,7111) 


T.AW t-p-rrrnnal forwards to 
Reconstitution server 


Source: 10.0.1.3 port 8111 
Destination: 200.101.55.1 port 
10015 

Payload: 44 

(132.14 6 .15. 101, 7111, 10 .0.1.1) 


allocates dedicated port 
20001 for source 10.0.1.1 / 
8111 


Source: 200.101.55.1 port 20001 
Destination: 132.146.15.101 
port 7111 
Payload: 44 


AddltUp server echoes back 
the negative number. 


Source: 132.146.15.101 port 
7111 

Destination: 200.101.55.1 port 
20001 

Payload: -44 


The reconstitution server 
looks up the dedicated port 
entry and sends the packet 
to the next round- robin LAN 
terminal on LAN 15 
(which happens to be 
10.0.1.4) 


Source: 200.101.55.1 port 8111 
Destination: 10.0.1.4 port 4567 
Payload: 
-44 

(132.146.15.101, 7111,10.0.1.1) 
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The LAN terminal receives 
the packet, reconstructs the 
header and forwards to the 
originating LAN terminal. 


Source: 132.146.15.101 port 
7111 

Destination: 10.0.1.1 port 8111 
Payload: -44 


APPENDIX B 
Packet 2 


AddltUp Client 
Send , 5 / 


Source: 10.0.1.1 port 8111 
Destination: 132.146.15.101 

— „f- Till 

pore /iix 
Payload: 5 


LSP intercepts. Sends to 
second LAN terminal in 
active list. 


Source: 10.0.1.1 port 8111 
Destination: 10.0.1.4 port 4567 
Payload: 5 

(132 . 14 6 . 15 . 101 , 7111) 


LAN terminal forwards to 
Reconstitution server 


Source: 10.0.1.4 port 8111 
Destination: 200.101.55.1 port 
10015 

Payload: 5 

(132 .146.15.101,7111,10.0 .1.1) 


Re constitution server has 
already allocated dedicated 
port 20001 for Source 
10.0.1.1 / 8111 


Source: 200.101.55.1 port 20001 
Destination: 132.146.15.101 
port 7111 
Payload: 5 


AddltUp server echoes back 
the negative number 


Source: 132.146.15.101 port 
7111 

Destination: 200.101.55.1 port 
20001 

Payload: -5 



WO 2005/018199 



- 17 - 



PCT/GB2004/003255 



The reconstitution server 
looks up tne aeaicatea poru 
entry and sends the packet 
to the next round- robin IAN 
terminal on LAN 15 (happens 
to be 10.0.1.3) 


Source: 200.101.55.1 port 8111 
Destination • 10.0.1.3 port 7654 
Payload: -5 

(132.146.15.101, 7111, 10 .0 .1.1) 


The LAN terminal receives 
the packet, reconstructs the 
header and forwards to the 
originating LAN terminal, 


Source: 132.146.15.101 port 
7111 

Destination: 10.0.1.1 port 8111 
Payload: -5 



APPENDIX C 



Packet 3 



AddltUp Client. 
Send x 18' 


Source: 10.0.1.1 port 8111 
Destination: 132.146.15.101 port 
7111 

Payload: 18 


LSP intercepts. Sends to 
next LAN terminal in 
active list 


Source: 10.0.1.1 port 8111 
Destination: 10.0.1.3 port 7654 
Payload: 18 (132 . 146 . 15 .101 , 7111) 


LAN terminal forwards to 
reconstitution server 


Source: 10.0.1.3 port 8111 
Destination: 200.101.55.1 port 
10015 
Payload: 

18 (132.146.15.101,7111,10. 0 .1.1) 


Reconstitution server has 
already allocated 
dedicated port 20001 for 
Source 10.0.1.1 / 8111 


Source: 200.101.55.1 port 20001 
Destination: 132.146.15.101 port 
7111 

Payload: 18 
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AddltUp server echoes back 
the negative number. 


Source: 132.146.15.101 port 7111 
Destination: 200.101.55.1 port 
20001 

Payload: -18 


The reconstitution server 
looks up the dedicated 
port entry ana. beiiu.o a-iic 
packet to the next round - 
robin LAN terminal on LAN 
15 (happens to be 
10.0.1.4) . 


Source: 200.101.55.1 port 8111 
Destination: 10.0.1.4 port 4567 
Pavload: - 

18 (132.146.15.101, 7111; 10.0.1.1) 


me XjAjn termj.naj. xeocivcti 
the packet, reconstructs 
the header and forwards to 
the originating LAN 
terminal . 


Source: 132.146.15.101 port 7111 
Destination: 10.0.1.1 port 8111 
Payload: -18 


APPENDIX D 
Packet 4 (Summation Packet) 


AddltUp server adds up the 
3 numbers (to 67) 


Source: 132.146.15.101 port 7111 
Destination: 200.101.55.1 port 
20001 

Payload: 67 


The reconstitution server 
looks up the dedicated 
port entry and sends the 
packet to the next round- 
robin LAN terminal on LAN 
15 (happens to be 10.0.1.3 


Source: 200.101.55.1 port 8111 
Destination: 10.0.1.3 port 7654 
Payload: 

67 (132.146.15 .101,7111,10.0.1.1) 
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The LAN terminal receives 


Source: 132.146 


15.101 port 7111 


the packet, reconstructs 


Destination: 10 


0.1.1 port 8111 


the header and forwards to 


Payload: 67 




the originating LAN 






terminal 







